Pose-Guided Multi-Granularity Attention Network for Text-Based Person Search

Text-based person search aims to retrieve the corresponding person images in an image database by virtue of a describing sentence about the person, which poses great potential for various applications such as video surveillance. Extracting visual contents corresponding to the human description is the key to this cross-modal matching problem. Moreover, correlated images and descriptions involve different granularities of semantic relevance, which is usually ignored in previous methods. To exploit the multilevel corresponding visual contents, we propose a pose-guided multi-granularity attention network (PMA). Firstly, we propose a coarse alignment network (CA) to select the related image regions to the global description by a similarity-based attention. To further capture the phrase-related visual body part, a fine-grained alignment network (FA) is proposed, which employs pose information to learn latent semantic alignment between visual body part and textual noun phrase. To verify the effectiveness of our model, we perform extensive experiments on the CUHK Person Description Dataset (CUHK-PEDES) which is currently the only available dataset for text-based person search. Experimental results show that our approach outperforms the state-of-the-art methods by 15 \% in terms of the top-1 metric.Comment: published in AAAI2020(oral

UrbanFM: Inferring Fine-Grained Urban Flows

Urban flow monitoring systems play important roles in smart city efforts around the world. However, the ubiquitous deployment of monitoring devices, such as CCTVs, induces a long-lasting and enormous cost for maintenance and operation. This suggests the need for a technology that can reduce the number of deployed devices, while preventing the degeneration of data accuracy and granularity. In this paper, we aim to infer the real-time and fine-grained crowd flows throughout a city based on coarse-grained observations. This task is challenging due to two reasons: the spatial correlations between coarse- and fine-grained urban flows, and the complexities of external impacts. To tackle these issues, we develop a method entitled UrbanFM based on deep neural networks. Our model consists of two major parts: 1) an inference network to generate fine-grained flow distributions from coarse-grained inputs by using a feature extraction module and a novel distributional upsampling module; 2) a general fusion subnet to further boost the performance by considering the influences of different external factors. Extensive experiments on two real-world datasets, namely TaxiBJ and HappyValley, validate the effectiveness and efficiency of our method compared to seven baselines, demonstrating the state-of-the-art performance of our approach on the fine-grained urban flow inference problem

Sound field separation technique using the principle of double layer patch acoustic radiation modes

In order to solve the problems of near-field acoustic holography in applications such as external interference and aperture effects, a sound field separation technique using the principle of double layer patch acoustic radiation modes is proposed in this paper. The radiated acoustic pressures over two planar surfaces at certain distances from the sources are calculated first. Then, the effects resulting from the backscattering interference in non-free sound fields can be eliminated by a double-layer sound field separation technique. Next, data interpolation and extrapolation are performed on the separated data to increase the sound source's pressures on the holographic plane equivalently for holographic images with higher spatial resolution. Simulation and experimental results demonstrate that good agreements can be obtained with few measuring points

Spinal disease diagnosis assistant based on MRI images using deep transfer learning methods

IntroductionIn light of the potential problems of missed diagnosis and misdiagnosis in the diagnosis of spinal diseases caused by experience differences and fatigue, this paper investigates the use of artificial intelligence technology for auxiliary diagnosis of spinal diseases.MethodsThe LableImg tool was used to label the MRIs of 604 patients by clinically experienced doctors. Then, in order to select an appropriate object detection algorithm, deep transfer learning models of YOLOv3, YOLOv5, and PP-YOLOv2 were created and trained on the Baidu PaddlePaddle framework. The experimental results showed that the PP-YOLOv2 model achieved a 90.08% overall accuracy in the diagnosis of normal, IVD bulges and spondylolisthesis, which were 27.5 and 3.9% higher than YOLOv3 and YOLOv5, respectively. Finally, a visualization of the intelligent spine assistant diagnostic software based on the PP-YOLOv2 model was created and the software was made available to the doctors in the spine and osteopathic surgery at Guilin People's Hospital.Results and discussionThis software automatically provides auxiliary diagnoses in 14.5 s on a standard computer, is much faster than doctors in diagnosing human spines, which typically take 10 min, and its accuracy of 98% can be compared to that of experienced doctors in the comparison of various diagnostic methods. It significantly improves doctors' working efficiency, reduces the phenomenon of missed diagnoses and misdiagnoses, and demonstrates the efficacy of the developed intelligent spinal auxiliary diagnosis software

Mixed active/passive robust fault detection and isolation using set-theoretic unknown input observers

2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting /republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other worksIEEE This paper proposes a robust fault detection and isolation (FDI) approach that combines active and passive robust FDI approaches. Standard active FDI approaches obtain robustness by using the unknown input observer (UIO) to decouple unknown inputs from residuals. Differently, standard passive FDI approaches achieve robustness by using the set theory to bound the effect of uncertain factors (disturbances and noises). In this paper, we combine the UIO-based and the set-based approaches to produce a mixed robust FDI, which can mitigate the disadvantages and exert the advantages of the two robust FDI approaches. In order to emphasize the role of set theory, the UIO design based on the set theory is named as the set-theoretic UIO (SUIO). A quadrotor subsystem is used to illustrate the effectiveness of the proposed FDI approach.Peer ReviewedPostprint (author's final draft

Robust state estimation and fault detection combining unknown input observer and set-membership approach

© 2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other worksThis paper aims to propose a new robust state-estimation and fault-detection method by combining the unknown input observer (UIO) and the set-membership estimator (SME). It is known that both the SUIO and the SME can be used to estimate the states of a system. The former aims to obtain a particular value by actively decoupling the effect of unknown inputs, while the latter can obtain state-estimation sets by prediction and correction based on the set theory. Instead of particular state values, the latter can obtain state-estimation sets guaranteeing to contain system states (i.e., robust state estimation). In this paper, we propose to use the framework of the UIO to actively decouple part of unknown inputs and then further employ the set-membership estimation method to estimate state sets and detect faults. The objective of the proposed method is to reduce the conservatism of robust state-estimation sets by using the UIO to remove the contribution of part of unknown inputs to the sizes of state-estimation sets. At the end of this paper, a numerical example is used to illustrate the effectiveness and advantages of the proposed approach.Accepted versio

Heat shock transcription factor 1 preserves cardiac angiogenesis and adaptation during pressure overload

To examine how heat shock transcription factor 1 (HSF1) protects against maladaptive hypertrophy during pressure overload, we subjected HSF1 transgenic (TG), knockout (KO) and wild type (WT) mice to a constriction of transverse aorta (TAC), and found that cardiac hypertrophy, functions and angiogenesis were well preserved in TG mice but were decreased in KO mice compared to WT ones at 4 weeks, which was related to HIF-1 and p53 expression. Inhibition of angiogenesis suppressed cardiac adaptation in TG mice while overexpression of angiogenesis factors improved maladaptive hypertrophy in KO mice. In vitro formation of vasculatures by microvascular endothelial cells was higher in TG mice but lower in KO mice than in WT ones. A siRNA of p53 but not a HIF-1 gene significantly reversed maladaptive hypertrophy in KO mice whereas a siRNA of HIF-1 but not a p53 gene induced maladaptive hypertrophy in TG mice. Heart microRNA analysis showed that miR-378 and miR-379 were differently changed among the three mice after TAC, and miR-378 or siRNA of miR-379 could maintain cardiac adaptation in WT mice. These results indicate that HSF1 preserves cardiac adaptation during pressure overload through p53-HIF-1-associated angiogenesis, which is controlled by miR-378 and miR-379